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NECESSARY CONDITION FOR NULL CONTROLLABILITY IN 
MANY-SERVER HEAVY TRAFFIC 

By Gennady Shaikhet 1 
Carleton University 

Throughput sub-optimality (TSO), introduced in Atar and Shaik¬ 
het [Ann. Appl. Probab. 19 (2009) 521 555] for static fluid models of 
parallel queueing networks, corresponds to the existence of a resource 
allocation, under which the total service rate becomes greater than 
the total arrival rate. As shown in Atar, Mandelbaum and Shaikhet 
[Ann. Appl. Probab. 16 (2006) 1764-1804] and Atar and Shaikhet 
(2009), in the many server Halfin-Whitt regime, TSO implies null 
controllability (NC), the existence of a routing policy under which, 
for every finite T, the measure of the set of times prior to T, at which 
at least one customer is in the buffer, converges to zero in probabil¬ 
ity at the scaling limit. The present paper investigates the question 
whether the converse relation is also true and TSO is both sufficient 
and necessary for the NC behavior. 

In what follows we do get the affirmation for systems with either 
two customer classes (and possibly more service pools) or vice-versa 
and state a condition on the underlying static fluid model that allows 
the extension of the result to general structures. 

1. Introduction. In this paper we consider many-server parallel queueing 
networks in heavy traffic regime. Despite the criticality, as shown in [5, 
6], there may exist a scheduling rule, with high probability maintaining 
the system without waiting customers, for “most of the time.” Called null 
controllability , such unusual phenomena occurs under the throughput sub¬ 
optimality of the underlying (critically loaded in a standard sense), fluid 
model. In the current work we try to understand if the effect can still be 
achieved when the underlying fluid is throughput optimal, and conclude that 
it is not possible and throughput sub-optimality is indeed required. 
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Fig. 1. A queueing model with four customer classes and three service pools. 

Our model of interest consists of multiple customer classes, indexed by 
X, and several service pools, indexed by J, each consisting of many i.i.d. 
exponential servers. The servers rates depend on both the station and the 
class. A system administrator dynamically controls all scheduling and rout¬ 
ing in the system; see Figure 1. The model is considered in the heavy traffic 
parametric regime, first proposed by Halfin and Whitt [9], in which the 
number of servers at each station and the arrival rates grow without bound, 
proportionally to some nfoo. 

Typically, when analyzing such systems, one looks at the underlying static 
fluid model, obtained in the law of large numbers limit of the processes 
involved. According to [10, 13], the so-called static fluid allocation problem 
(see Section 2.2 for the details) should then be formulated to determine 
whether the model (hence, the original system) is under, over or critically 
loaded; the latter being the proper foundation for the heavy traffic analysis. 
What one gets is a deterministic matrix £*, where for (i,j) £ X x J, the entry 
represents the fraction of station- j work dedicated to class-i customers on 
the fluid level. Consequently, the original network is called critically loaded 
if the optimized fluid takes 100% of system capacity; that is, JT £*)■ = 1 for 
each j £ J. The class-station pairs ( i,j ) £X x J, along which the service 
is possible, are called activities. The activities ( i,j ) for which S*- > 0 (resp., 
£ij =0) are regarded as basic (resp., nonbasic). In both [10, 13] the set £* 
was assumed to be unique as well as to satisfy the complete resource pooling 
condition, requiring all vertices in the class-station graph to be connected 
via basic activities. Under the uniqueness assumption, the latter was shown 
to be equivalent for the graph of basic activities being a tree. The above 
set of conditions on the underlying fluid model has become standard for 
considerable amount of works in the conventional (e.g., [10, 11, 13], etc.) 
and Halfin-Whitt (e.g., [1, 2, 4], etc.) heavy traffic regimes, as well as in the 
more recent, nondegenerate-slowdown (NDS) regime [3]. 

With the static fluid model set, an attempt is then made to prove that ap¬ 
propriately scaled (Halfin-Whitt regime) fluctuations of the queueing model 
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about the fluid model converge to a diffusion. Assuming no use of nonbasic 
activities, the pioneering papers [1, 2, 4] were able to represent the scaled 
system dynamics as a controlled diffusion with a drift control , thus being able 
to determine asymptotically optimal scheduling policies for the fairly large 
class of operational costs. It is a general understanding (see Theorem 2.1 in 
[5] and Theorem 3.3 in this paper) that by including the nonbasic activities 
one gets additional controls, this time singular controls, but the augmented 
controlled diffusion still remains to be fully analyzed. 

Yet, some partial results had been obtained. One of them, called null con¬ 
trollability will be the focus of our attention. In particular, in [5], Theorems 
2.3, 2.4, it was shown that in the presence of nonbasic activities, some mod¬ 
els are prone to a fairly unusual effect when a critically loaded system starts 
to behave like an underloaded system. More exactly, one can construct a 
policy, under which for any given 0 < e < T < oo all queues in the system 
are kept empty on the time interval [e, T], with probability approaching one 
(a finiteness of the interval in [5] is crucial, and was later supported by the 
results from [12] indicating that the phenomenon is not possible in the long 
run). It is also worth noting that null controllability seems to be the fea¬ 
ture of the Halfin-Whitt regime only—by its nature, it cannot happen in 
the conventional single server asymptotics—and the conventional-like NDS 
regime is not expected to have it either. 

The results of [5] were generalized and better explained in [6], attributing 
the null controllability to what was called throughput sub-optimality of the 
underlying static fluid model, a situation, when (static) resources can be re¬ 
arranged so that the total service rate becomes greater than the total arrival 
rate; see Section 2.3 for the exact definition. Throughput sub-optimality, it 
appears, may occur in wider class of fluid models and, even when the null 
controllability is impossible, can result in its weaker (though still efficient) 
version. Namely (Theorem 1 of [6]), for every finite T, the measure of the set 
of times prior to T, at which at least one customer is in the buffer, converges 
to zero in probability at the scaling limit. 

This brings us to the main objective, to understand the converse relation 
between throughput sub-optimality and (weak) null controllability (Theo¬ 
rem 2.4). We show that the desired property is rooted in a simply formulated 
deterministic result (Theorem 3.4) stating that a throughput optimal static 
fluid model does not become sub-optimal if its fluid amounts are modified 
along the so-called zero paths, simple paths p from [6] with signed weight 
fi(p) = 0. This gives a new interesting perspective on zero paths, normally 
not associated with abrupt changes of fluid material; in contrast with “unwel¬ 
come” positive paths /a(p) > 0 that increase the material, or negative paths 
/j,(p) < 0, the existence of which, as shown in Theorem 2 of [6], is equivalent 
to throughput sub-optimality. Both Theorem 3.4 and its dynamic version 
Lemma 3.6 are proven for systems with either two customer classes (and 
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possibly more service pools) or vice-versa. Although the full version of The¬ 
orem 3.4 still remains unresolved, its simplistic nature [checkable relations 
(3.13)—(3.14)] allows us to partially generalize the results for arbitrary I and 
J (Theorem 4.3). 

The organization of the paper is rather straightforward, with the main 
result (Theorem 2.4) followed by its proof (Section 3). Sections 2.1-2.2 pro¬ 
vide all the prerequisites, while Section 3.1 is the roadmap for the proof. 
After that, Theorem 4.3 of Section 4 discusses possible extensions of our 
findings. 

Notation. For a positive integer d and x £ M d , let ||x|| = Yli=i \ x i\- T° r 
v,u € R d let v ■ u = Yli=i u i v i- The symbols e* denote the unit coordinate 
vectors and e = (1,..., 1). The dimension of e may change from one expres¬ 
sion to another. Thus, for x = (aq,..., Xd) £ M d , we have e ■ x = Yli =l x i- 
For an event A we use 1{A} for the indicator of A. Denote by II)(R d ) 
the space of all cadlag functions (i.e., right continuous and having finite 
left limits) from R + to M d . Denote |X|jf = sup 0<u<t |X(??)| for X £ D(M), 
Ill’ll* = sup 0 < u <t \\X(u)\\ for X € B(M d ) and f(t: s ) = f(t) - f(s). 

2. The model and the main result. 

2.1. Original model. The setting is standard; see, for example, [2, 4-6]. 
A complete probability space (fl,.X,P) is given, supporting all stochastic 
processes defined below. There is a sequence of systems indexed by n £ 
N, each having I customer classes and J service stations. Station j has 
Nj 1 identical servers. The classes are labeled as 1and the stations as 
1 + 1,..., 1 + J. We set X = {1,..., /}, J = {/+1,..., / + J}. The arrival and 
service processes, all mutually independent, are denoted by {A™,i £l] and 
{S™j, ( i,j ) GX x J}. Each A” is a renewal process whose inter-arrival times 
have finite second moment and an inverse mean (or rate) equal to A" > 0. 
Each service process S'£ is a Poisson process with rate /?X > 0. We also allow 
a possibility for /?”■ = 0, in which case we say that class-? customers cannot 
be served at station j. 

Denote the set of all class-station pairs by £ := X x J, let £ a = {(?, j) £ 
X x J : /?X > 0}, and, throughout, assume that £ a does not depend on n. A 
class-station pair (i.j) £ £ a is said to be an activity. The set of class-station 
pairs that are not activities is denoted by £ a = £ \ £ a . 

The number of service completions of class-? customers by all servers of 
station j by time t is therefore (see, e.g., [2, 4-6]), given by S'X(Jq 'I'X(s) ds), 
where for every (■ i,j) £ £ a , we denote by 4?X(f) the number of class-? cus¬ 
tomers being served in station j at time t. Denote by Xp(t) the number of 
class-? customers in the system at time t. By definition, 

(2.1) xp(t) = X”(0) + A”(() - E S 3 ( /' 4 '3( s ) ds ) • i « 

KJ K - la 1 


NECESSARY CONDITION FOR NULL CONTROLLABILITY 


5 


(2.2) ]Ta»(()<X”(i), i€l; j£j. 

jej iex 

The processes are regarded as scheduling control policy 

(SCP) and assumed to be right-continuous, taking values in Z+. Thus 

(2.3) *£(*)> 0, (i,j)es a - *?■(*) = 0, (i,j) G ££■ 

Note that the above definition of SCP is very general and does not include 
the standard requirements; see, for example, [2-4, 6]. 

2.2. Static fluid model and throughout sub-optimality. The paper deals 
with certain properties of an underlying fluid model, to be introduced in this 
section. We start with the first order approximations of the parameters. 

Assumption 2.1. There exist constants A*, Vj G (0, oo), i G X, j G J and 
Pij G (0, oo), (i,j) G fa, such that n _1 Xf —> A —> Vj , /j”- —> mj. Let 
IMj= 0 for {i,j)e£l- 

The above assumption allows one to imagine a model where arrival and 
service processes are deterministic flows with rates \ and pij. There are J 
service stations, processing I classes of incoming fluid. Station j has capacity 
to hold Vj units of fluid. Since routing/scheduling is an important part of 
managing the network, an allocation of work among the stations is pivotal 
element of the model. The static fluid model uses a fixed allocation for all 
times (hence “static”). Let E be the set of allocation matrices 

Cij, (b j) G £ , such that > 0, and < 1, Vj G J 

iex 

where each entry represents the fraction of station’s j capacity allocated 
to process class-*. When station j contains 'i/’u : = £ijVj units of class-* fluid, 
the rate at which this fluid is processed is Pijipij = p-ij&j, where we set 
flij = mjVj. The allocation matrix £* to our model will be chosen according 
to the following rule. 

Assumption 2.2. Consider the following static allocation problem [10]: 

(2.4) min p, subject to Y] flijCij = b;,Vf, V'&j ^ Vj, 

jej iei 

and assume it has a unique solution (£*,/?*), satisfying: 

(1) p* = 1 and EiexCj = 1 for a11 3 

(2) the set of activities (edges) (i-j) G £ a , for which > 0, form a con¬ 
nected tree in a graph with the set of vertices IU J . 
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For convenience, we choose to keep this standard set of assumptions 
throughout the paper, but, in fact, neither the uniqueness, nor the tree¬ 
like structure is crucial. See more explanation in Section 5. For the solution 
f* from Assumption 2.2 we denote 


(2.5) 


V*j ~ O' 




* 

Xa = 


!>«■ 


i £ T. j £ 77. 


Thus x* represents the mass of material of each class being processed in 
all service stations. The introduced deterministic model, with parameters 
{A,^, /i} and allocation matrix {ip*}, satisfying Assumption 2.2, will be re¬ 
ferred to as the static fluid model. Following [10, 13], an activity (i,j) € £ a 
is said to be basic (resp., nonbasic ) if '(/A > 0 (resp., '(/A = 0). 

Throughput sub-optimality. For x £ M. 1 , and v £ JR/, define 


( 2 . 6 ) 


E(x,u) := l ££--ipij > O,^ 

^ iei 


< £ J 


and ^2 'ipij < Xi , Vi £ X 
j&J 

Note that from (2.5) we have ip* £ z.{x*,v). Assumption 2.2 expresses the 
critical load on the system, but does not discard the possibility that the total 
processing rate can exceed the total arrival rate. For a static fluid model we 
will say that it is throughput optimal if the following holds: 

(2.7) Whenever ip £ H(x*, u), one has IMji’ij — ^2 -V 

(i,j)&£ *6X 

The model is said to be throughput sub-optimal if it is not throughput 
optimal. 

2.3. The main result. The following assumption regards the second order 
behavior of the parameters and initial condition. 

Assumption 2.3. There exist c£ (0,oo), independent of n, such that 
for n > 1, 

||n -1 A n - A|| + \\p n - m|| + ||re _1 A n '(0) - || < cn“ 1/2 , 

( 2 . 8 ) 

|| n~ l N n -v n \\ < (1/2 )n~ 1/2 . 

Theorem 2.4. Let Assumptions 2.1-2.3 hold. Assume 1 = 2 or J = 2. 
If, for some T > 0, there exists a sequence of SCPs, under which 
rT 


(2.9) 


[ {e ■ X n (s) > e ■ N n } ds —>■ 0 

Jo 


in probability, 


then the underlying static fluid model is throughput sub-optimal. 
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3. Proof of Theorem 2.4. 


3.1. Intuition and preparations. First, we outline the main ideas of the 
proof. Fix n. It would be convenient to rescale the system dynamics with 
respect to the static fluid model. Namely, we rewrite (2.1)-(2.3) in the form 

(3.1) x?(t) = x?(0) + wp(t)-'£ l n ij f%{s)ds , *ei, 

jej Jo 

(3.2) X^.(t)<Xr(t), ^^.(f)<iV”, jej, 


i&J 

i&X 

where we use 



i 

e 

II 

<^o 

(3.3) X?(t) = n~ 1 / 2 (X?(t)-nx *), 

%{t) = n 

Nj 1 = n~ l / 2 (NJ - nuj) 


and 


w?{t)=A?{t)-Y J s? j ( r 


j£j 

J 

(3.4) 


+ n~ 1 ^ 2 (Af — n\i)t 

-«" 1 / 2 Ek- 


y ' 


y 


■y' 


16 j 


The proof will be completed in several steps. The basic principle would 
be to show that, once the underlying fluid model is throughput optimal, it 
is impossible to quickly eliminate a nonnegligible surplus of customers. 

• Our main candidate for a fast unloading of the system will be the last 
term of (3.1), since W n is well known to be tight; see, for example, [2, 4, 6]. 
Now, due to throughput optimality (2.6), (2.7), since € E(X n ,N n ), we 
have a crude estimate 

(3.5) < A‘n«(l|V n (t)|| + ||iV n ||), t> 0, 

y 


for /r max = maxjj}, which tells us that, in principle, the left-hand side 
of (3.5) can be made large by quickly increasing ||X n ||. Of course, stopping 
the service (partially or completely) will do the trick, but will not serve our 
purpose, thus inviting the question whether, and if so, in what directions, 
X n can be quickly changed without significant increase of the total mass 
e-X n . 

• To answer the above we would need Theorem 3.3 of Section 3.3, namely, 
representation (3.10), showing that it can be done by using the nonbasic 
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activities along the so-called zero simple paths, the objects first introduced 
in [6], but with fi(p) = 0. To make this paper self contained we have included 
Section 3.2, reminiscing about the basic definitions of simple paths from [6] 
as well as their connection to throughput optimality (Theorem 3.2). 

• The representation theorem prompts us back to the static fluid model 

in an attempt to understand whether one can increase the throughput by 
inflicting changes along zero paths. The corresponding Theorem 3.4 of Sec¬ 
tion 3.4 provides the desired negative answer and culminates in its dynamic 
version (Lemma 3.6 of Section 3.5), essentially saying that there is no way 
to quickly increase without increasing e • X n , which is quite the 

opposite of what we are trying to achieve. 

• The details are finalized in Section 3.6. 

3.2. Simple paths. Characterization of throughput sub-optimality. De¬ 
note the index set for all customer classes and service stations by V := ZU J. 
For a nonempty set V and E C V x V, we write G = (V,E) for the graph 
with vertex set V and edge set E\ see, for example, [8] for standard defini¬ 
tions. A connected graph that does not contain cycles is called a tree. We 
denote Q a = (V,£ a ) an d refer to it as the graph of activities. 

Define the graph of basic activities Gba to be the subgraph of G a having 
V as a vertex set, and the collection 

4:={(u')£4:(*'> 0} 

of basic activities as an edge set. By Assumption 2.2, the graph Gba is a tree, 
and by construction of it as a subgraph of Q a , all its edges are of the form 
(i,j) where i Si and j £ J. In the definition below and elsewhere in this 
section, it will be convenient to identify (i,j) with (j,i) (where i£l and 
j £ J) when referring to an element of the edge set £. Although the notation 
is abused, there will be no confusion, since X and J do not intersect. 

Definition 3.1. (i) A subgraph q = (V q ,£ q ) of Gba is called a basic path 

if one has V q = {i 0 ,jo, ■ ■ ■, ik,3k} and 

£q = {(* 0 .jo), (j 0 1 *l) j • ■ • j {Ik-i 

where k > 1 and zo,... ,ik £X, jo,.. .,jk € J are 2k + 2 distinct vertices. 
Note that every edge of a basic path is a basic activity (i.e., an element of 
£ba)- Basic paths are used to define simple paths, as follows: 

(ii) Let the leaves io and jk of a basic path q be denoted by i q and, 
respectively, j q . The pair (i q ,j q ) could be an activity (an element of £ a ), 
in which case it is necessarily a nonbasic activity (i.e., an element of £ a \ 
£ba ), and we say that the graph (V q ,£ q U {{i q , j q )}) is a closed simple path ; 
otherwise ( i q ,j q ) is not an activity (i.e., it is in ££), and we say that q itself 
is an open simple path. We say that p is a simple path if it is either a closed 
or an open simple path. Let SP be the set of simple paths. 
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Example. Consider the following static fluid model, with 2 classes of 
customers and 3 stations: 


and 


v = 


A = 


Case A : /r = n = 
Case B : ji = jl = 


3 10 1 

1 4 2 

3 10 1 

0 4 2 


The resulting optimal static allocation (2.4), (2.5) in both cases is given 
as 




f 1 0.5 0\ 

Vo 0.5 l) 


and x* 



and we can visualize the graph of activities on Figure 2. In both cases we 
have the same Qy a , consisting of vertices {1,2,3,4,5} and edge set £y a = 
{(1,3), (1,4), (2,4), (2,5)}. Similarly, both cases have two basic paths [recall, 
we identify (i,j) with (j,i)} 


9! = {(3,1), (1,4), (4,2)} and q 2 = {(1,4), (4,2), (2,5)}. 


The basic path q \, together with the corresponding leaves 3 and 2, defines a 
path p = {(3,1), (1,4), (4,2), (2,3)} which will be closed if p 2 3 > 0 [i.e., (2,3) 
is an activity, case A] and open otherwise (case B). The only other possible 
simple path {(5,2), (2,4), (4,1), (1,5)} in both cases will be a closed one. 


Next, we associate directions with edges of simple paths. Let p be a simple 
path, and let q = q p = (V g ,£ q ) be the corresponding basic path with £ q = 
{(*o, Jo), • • •, (ikJk)}, where i 0 ,...,i k €l and j 0 ,... ,jk € J. The direction 
that will be associated with the edges in £ q , when considered as edges of p, 
is as follows: j k -A i k —>• j k —i -A i k -1 -A • • ■ -A jo -A iq. In the case of an open 


1 2 



1 2 


3 4 5 


Fig. 2. Simple paths for cases A and B: On the leftp is a closed simple path, while on the 
right p is open. For case A, p .23 > 0 and (2,3) is a nonbasic activity. For case B, p 23 = 0 
and (2,3) is not an activity. 
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simple path, this exhausts all edges of p. In the case of a closed simple path, 
the direction of (io,jk) is *o jk- We note that an edge (corresponding to 
a basic activity) may have different directions when considered as an edge 
of different simple paths. We signify the directions along simple paths by 
s(p,i,j ), defined for * €l, j G J, ( i,j) € £ p , p € SP, as 


(3.6) 


= < 


- 1 , 

1 , 


if (i,j), considered as an edge of p, 
is directed from i to j, 
if (i,j), considered as an edge of p, 
is directed from j to i. 


Set 


(3.7) 


and 


rrH.p = Y 


iGl, m p = Gl) 


(3.8) p(p) = Y m i,P= Y 

(i,j) es p 


Example (cont.). Referring to the simple path p, for case A we have 
p(p) = —7 + 3 = —4 since 

m 1:P = s(p , 1,3)/ri3 + s(p, 1,4)/ii4 = IM 3 - p 14 = -7, 
m 2 , P = s(p, 2, 3)p23 + s(p, 2,4)^24 = ~P23 + P 24 = 3. 

Similarly, for the case B we have mi tP = —7, m 2jP = 4 (since /i 2 3 = 0) and 

p{p) = -3- 


Theorem 3.2 (Theorem 2, [6]). Let Assumptions 2.2 and 2.3 hold. Then 
the following statements are equivalent: 

(1) the static fluid model is throughput sub-optimal; 

(2) there exists a simple path p € SP such that p(p) < 0. 


Example (cont.). Both cases have a path with p(p) < 0, hence both are 
throughput sub-optimal. To see that, for example, the fluid model in case A 
is throughput sub-optimal, let /3 > 0 be sufficiently small, and consider the 
allocation matrix 

t_( 1 ~P °-5 + /3 0\ 

€ l P 0.5 — P 1 J ' 

Clearly, we have ZijVj = x * f° r every i. However, J2(i,j)e£ Aij > Ai + A 2 . 
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3.3. Representation. 


Theorem 3.3. Let X n and satisfy (2.1)-(2.3). Then there exist 
processes <h n , M n and T n , satisfying: 


(1) € E(X n (t),N n ) fort> 0 and T"- = 0 for (i,j) £ £ ba ; 

(2) ||<l> n (i)|| < CF(\\X n (t)\\ + ||iV n ||) for some constant cf, independent of 
t,n; 

(3) M n G T n G B(M^) ; are component-wise nondecreasing, ini¬ 

tially zero, so that the following holds for the scaled processes 2 for t > 0, 
i G .1 


(3.9) 


X?(t) = X?(0) + W l n (t)- Y, ^[%{s)ds 

j:(i,j)e£a 0 

+ X] m iiP M-(t) + T2(t). 

p&SP 


The proof is relegated to the Appendix. Together with inequality (2), 
which is obviously stronger than (3.5), the theorem indicates that the last 
two terms of (3.9) are the only possible reasons for the abrupt change of 
||A n ||. The summation term is associated with simple paths, while the last 
term corresponds to direct nonwork conservation; see the proof for more 
details. The theorem can be viewed as a generalization of Theorem 2.1 from 
[5] where only closed simple paths (called cycles) were considered. 

For a simple path p G SP, we say pGfbj (resp., p G V -; or p G V+) if 
p{p) = 0, [resp., n(p) < 0; or fi(p) > 0 ]. Depending on the subscript sign of 
V the paths will be called, respectively, zero, negative or positive paths. 

If the static fluid model is throughput optimal (in which case Theorem 3.2 
implies V _ = 0 ), we rewrite (3.9) as 


x?(t) = x?(0) + w t n (t)- 

(3.10) 


y! Tij 

3 


f 


^(s)ds + C(t) + V?(t), 


i E X, 


where 

(3.11) Q(t) = Y 

p&Vo 


5?(*)= E ”i. P V”(t)+T?(t). 

P&V+ 


Notice that Cf 1 and rf L satisfy [due to (3.8) and nonnegativity of T™] 

(3.12) e • ( n (t) = 0, e-rp(t)> 0. 


2 We use :=rW 1/2 ($% M n ~n~ 1/2 M n and T n :=n~ 1/2 T n . 
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3.4. Discarding zero paths. From (3.10)-(3.12) we see that both ( n and 
rj n can lead to abrupt increase of ||X n ||, though only rj n that can do such 
for e ■ X n . The next deterministic (key!) result, viewed as a prelude to es¬ 
timate (3.27) of Lemma 3.6, discards any significant influence of zero paths 
(represented by ( n ) on system’s drift. 

Theorem 3.4. Assume that the static fluid model, (as defined in Sec- 

\'Ty I 

tion 2.2), is throughput optimal. Take an arbitrary vector M , with 

\\M\\ small enough, and set 

(3.13) x = x* + ^2 mpMp. 

p&V o 

Then, if either 1 = 2 or J = 2, the following inequality is true: 

(3.14) £ HijAj < Yl 

ij ij 

for all if £ H(x, v). 

Before proving the theorem, we point out an important corollary. 

Corollary 3.5. Let the static fluid model be throughput optimal. As¬ 
sume we are given some xq £ M.(_, v £ R+, 7 £ and a set of numbers 
{M p >0,p£VoU V+} with \\M\\ sufficiently small. Define x = xq + ( + g, 
where 

(3.15) (j = m i:P M p , m := £ m l , p M p + li Vi € T. 

peVo p€"P+ 

Then, if either 1 = 2 or J = 2, for all if £ H(x, u), we have 

(3.16) - V' ij ) HfyGlxo -x*\\ + \\v-v\\ H- e - 77 ), 
ij 

where c M is a constant, independent of f, g, M. 

Proof. Just note that x = x* + ( + (xo — x*) + 7 = x + (xo — x*) + rj for 
x from (3.13), together with (3.14) yielding ^ ~ ^*j) < /Wx(||zo ~ 

x*| + \\v~ u \\ + \\v\\) an d the corollary follows since p,(p) > 0 for each p £ V+, 
and 

Mmax 11 V 11 — Mmax f ^ ( 11 TTlp \ \ Alp T 6'7i J 

\er+ ' 

< Cp ( v(p) M p + e ■ 7* J = c u( e ■ v) 

\&>+ J 


(3.17) 
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for Cfj, = ^max(l + min{c > 0: ||m p || < c/j(p), for all p £ V+}). □ 

Proof of Theorem 3.4. We will start with a basic case when I = J = 
2 then extend it to more general systems. 

Case 1: let X = {1,2} and J = {3,4}, and assume the (unique) basic path 
is given as q = {(3,1), (1,4), (4,2)} with (2,3) being either nonbasic activity 
or not an activity. The corresponding simple path p belongs to Vo, and hence 
satisfies 

(3.18) mi, p + m 2 , p = (pi3 - Vu) + (a*24 - ^ 23 ) = 0. 

Take a small enough M > 0, set A := (^13 — pm)M = (p 2 3 ~ V 2 a)M and 
define a new x = (x\,x 2 ) = (x\ + A, x\ — A). Because of (3.18), an elementary 
argument implies that any throughput optimizing allocation matrix if is of 
the form = ifn 

(3.19) ^23> ^ 24 ) = ($L3 - 7, #L4 + A + 7> 7, V'24 - A - 7 ) 

for some 0 < 7 < min{^ 3 , ^24 — A}, with the total throughput remaining a 
constant, independent of 7, 

(3.20) = ^13/^13 + W>14 + A )/ i 14 + (V>24 ~ A)/i 2 4- 
ij 

Assume, on the contrary, that > Ai + A 2 . Due to (3.20), the 

latter inequality will hold for any feasible 7. In particular, take 70 = Mp 24 - 
It is easy to check that with such a choice, we have [recall A = M(p 2 ^ — ^ 24 )] 

(3.21) ^23^23 + ^24^24 = A 2 . 

Together with Vi j > Ai + A 2 , it means 

(3.22) ^i3//i3 + V’u/Wi > Ai, 

clearly contradicting the static fluid allocation problem; see Assumption 2.2. 
Indeed, (3.21)-(3.22) means there is a static fluid allocation (^ 13 , ^14 > ^ 23 > 
V’ 24 )) with ^13 < that fully serves each of the two incoming classes 
without using all the capacity. 

Case 2: now consider the case I = 2 or J = 2. An important property of 
such systems is that each simple path consists of four vertices and three or 
four edges, depending whether or not it is open or closed; and the arguments 
from case 1 will be very helpful. In particular, we argue that the statement 
of the theorem remains true if only one zero path modification is applied, 
that is, if x = x* + m p M p for some path p£V 0, then JT ■ Pij'fij < Yhij Viji’ij 
for any if £ S(x, v). Indeed, let, on the contrary, there exist a through¬ 
put maximizing allocation if £ E(x,^) satisfying ]T7 . Hij'f’ij > Vij'&tj- 
Let Vp = {i\,i 2 ,j\,j 2 } with a nonbasic (i 2 ,j\). Then, again, due to ppj 1 — 


14 


G. SHAIKHET 


Hi 1: j 2 + IM2.32 ~ l l i-2,ji = 0 [recall (3.8) that p € Vo], we have that the following 
allocation: 

= for (i,j)(£p, 

= i^n ~ 7 , iPt, j2 + A + 7,7, ip* 2j2 - A - 7) 
will satisfy Yjij = Yij Piji’ij > Yij Vij^ij for an Y feasible 7 and A = 
M p mi 1)P = —M p mi 2)P , bringing us precisely to the first case and, hence, to a 
contradiction. 

Now we extend the latter to several zero paths. Set k = \Pq\ > 1 . Once 
again, assume that there exists a throughput maximizing matrix -0 € v) 
that satisfies Yij k’ij'^ij > Yij ^ij^ij- Consider an allocation matrix if of the 

form 'ip^ = YpeVo^ij^ w f iere [slightly abusing the notation and denoting 
V p = {i\, i%, j\, ]%} with a nonbasic P er each path p], 

= for (i,j) ££ P , 


(3.24) 


(dp) iip) jip) tip) 

V YaP aP ? YaP aP j YaP aP j YaP 
*101 *102 l 2 01 fc 2 ’ 


iV 


~ ’ \^hl + AP ’ 0) l^hl - AP 

with A p = M p rn,jP p = —M p mjV p . Once again, since each simple path p be¬ 


longs to V 0 , we have Yij Vij^ij = Yij PijAj > Yij l'ij i: ij- Now consider k 
completely separated from each other systems with identical set {/%}, but 
with arrival rates and capacities divided by k. Clearly, the values { j-Yt-j } 
will solve the static fluid allocation problem in the smaller systems. Let 
each of the smaller systems correspond to each of the possible p & Vo- To 
each system apply a modification along the corresponding path 


(3.25) 


= jx* + m p M p 


The allocation {ijjY } from (3.24) optimizes the throughput in the corre¬ 
sponding small system and satisfies (since we have already treated the case 
when only one p G Vo has been activated) 


(3.26) 


ij ij 


implying overall 

ij ij V peVo ' p&v 0 V ij ' ij 

which completes the proof by contradiction. □ 
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3.5. Important estimate. Consider the event R™ = {||7l n Hi + ||S' n ||* < 5}. 

Lemma 3.6. Let Assumptions 2 . 1 - 2.3 hold, assume that the static fluid 
model is throughput optimal, and let I = 2 or J = 2. Then, on the event R”, 
for any scheduling policy, we have, for e > 0 small enough and t < 2s, 

(3.27) X>«®«(*) £ e_2/3 ( 1 + K e ' A‘) + m. 

ij 


Remark 3.7. In fact, the above inequality holds for some constant k, 
but for our purposes a crude bound of k < e~ 2 / 3 will be enough as it saves us 
the trouble of adjusting essentially irrelevant constants after each operation. 

Proof of Lemma 3.6. We will start by showing the relation 

(3.28) ^ Wj ^.(f)<e- 1/2 (l + (e-X"(t)) + + e-7f(t)), t> 0. 

ij 

Recall (3.5) 

(3.29) ^M. J $5(«)<f‘»«(ll-Y(*)ll + l|JV”||), t> 0. 

ij 

Due to (2.8) and since e • rj n and is a nondecreasing process starting at zero, 
inequality (3.28) will follow for all t when ||X n (t)|| < e _1 / 3 (l + e • rflit)). 
Now consider the case when ||X n (t)|| > e _1 / 3 (l + e • rf L (t)). 

First, assume there is only one class i with \Xf{t) \ > £ / (\ + e-rf l {t )). If 
Xf(t) < 0, relation (3.28) clearly follows from (3.29) since the left-hand side 

\/3 

of (3.28) would only increase if Xf(t) is increased to — e I (1 + e ■ rflif)). 
Otherwise, if Xf(t) > 0, relation (3.28) follows from 

(e • X n (t)) + > e ■ X n (t ) > xp(t) - e —1/3 (1 + e • rfl(t)), 

— —" — 1/3 

because for all other classes j fli we have X™(t) > — |X/(f)| > — £ 1 (1 + 

e-fl n (t)). 

^ — 1/3 

For the rest of the proof assume that \Xf(t)\ > £ / (1 + e • rj n {t)) for 
several different V s. From (3.9)-(3.12) we have (using the fact t < 2s) 

11*1; < H^wii + \\w”\\;+2ec F (\\x% + iijv"id + wcm 

(3.30) 

+ mm- 

Using (3.17), we have ||r/ n (t)|| < (c /i //Lt max )e • rj n (t). Moreover, due to the 
lemma’s assumptions, we have [see (3.4)] ||X n (0)|| + ||fU n ||* < e" 1 / 6 for s 
small enough, altogether implying 

(3.31) ||X n (t)|| < \\X n \\* t < £-^(1 + ||C n (t)|| + e • if(t)). 
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Since ||A n f )|| > e 1 / 3 (1 + e • iff)), inequality (3.31) would imply 
(3.32) ||C”(()||>(e- 1 /a -l)(l + e->f(()), 


that is, there is at least one large “zero path” (i.e., p £ Vo) activity usage 
and we are going to apply Corollary 3.5 to “filter out” the effect of such. 

First, if / > 2, J = 2, then all vertices i El, except for one (denote it by 
k), are leaves in the tree of basic activities Qb a . For each leaf iq there is a 
unique simple path p, going through f and k. 

Consider the following procedure: Let Tq = Tq f) = {i Sl\{fc} : |Aff)| > 

£ j' A (1 + e-if f))}. For i E Io(t) define Xi := £ 1 + e-ifand set 

Xk -=^k W + Finally, for (Z 0 U{fe}), set x i = X?(t). 

Viewing vector X n as if it has been obtained from x by applying \Xq\ zero 
paths to the latter [as (2.8) we obviously have ||V n ||* < ||V Tl (0)|| + ||^. n ||i + 
2 cn 1//2 e < n \SP\ ( n mhp.j ip*j) on , so the perturbation is indeed sufficiently 
small when viewed on the fluid level], one can use Corollary 3.5 to get 


(3.33) 


< c ,,(\\N n \\ + ||x|| +e-rj n {t)) 
ij 

< c M (||^ n || + xt + e” 1/3 (l + e • if (t)) + e • if (i)). 


In the last inequality we once again use the fact that only strictly positive 
Xk was worth considering [otherwise the left-hand side of (3.33) would only 
increase if Xk is increased to — £ f (1 + e ■ if (£))]. A crude estimate Xjf < 
(e • X n (t)) + + e" 1//3 (l + e ■ if (t)) that follows from the definition of Xi and 
the relation Xk = e ■ X n (t) — ^iex 0 x% completes the proof of (3.28). If I = 2, 
the same procedure is applied only once, along any of several possible zero 
paths. This proves (3.28). 

To finalize the lemma, note that from (3.9)-(3.12) satisfies d> n (t) £ 
S(X n (t),N n ) for all t in the given range, hence is subject to (3.28) as well. 
Using that, we have 

(3.34) |(e • X n ) + \* t > e ■ X n (0) - e • W n (t ) + e • if (t) 

(3.35) -f / 2 (1 + | (e -X-) + | I + e-ifCO) 

(3.36) >C+\e- iff) - e 1/2 |(e • X n ) + \* 
implying 

(3.37) e • iff) < £-V 5 (l + |(e • X n ) + \* t ), 

and we complete the proof by substituting (3.37) into (3.28). □ 
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3.6. Finalizing the proof. For arbitrary e > 0, consider the event 
Qf = n«(e) = m n {e ■ X n (0) - e • N n + e ■ A n (e) > 4} 

(3.38) n{||>(-)->( £ )||^ 2 £] <l/4} 

n{||^||t<i/4}. 

It is standard (e.g., Theorem 14.6 in [7]) that component-wise both A n and 
S n converge weakly to independent Brownian motion processes. Therefore 
there exist constants n\ = ni(e) € N and 5 = 6(e) > 0, so that P(fi”) > 5 for 
all n>n\. 

Fix e > 0. Theorem 2.4 guarantees that there exists a sequence of SCPs 
satisfying 

l{e- x n {s) >e- A^ n }ds>e|^ = 0 . 

Let Q n = {/ 0 T l{e • X n (s) > e • N n } ds < e}. Relation (3.39) implies that 

there exists a constant no (e) G N so that 

(3.40) P(O n ) > - for all n > n q. 

In what follows we assume that the static fluid model is throughput optimal 
and will come to a conclusion that the event Cl n is impossible (i.e., is an 
empty set) for n>n o and e small enough, thus contradicting (3.40). 

From (3.1), (3.4), (2.8), Lemma 3.6 and (3.38) on the event Q n , 

(3.41) e • X n (e) - e ■ N n > 7/2-ce- e 1/3 (l + |(e ■ X n ) + |*), 


(3.39) 


lim P 

n—> oo 


which, for e small enough, yields 

(3.42) e • X n (e) - e ■ N n + e 1/3 1 (e • X n ) + \* > 2, 

giving us two possible scenarios: e • X n (e) — e ■ N n > e 1 / 3 ^ • X n ) + \* and 
e 1 / 3 |(e • X n ) + \* > e ■ X n (e) -e-N n . 

Case 1. Assume e-X n {e) — e-N n > e 1 / 3 |(e-X n ) + |*. Together with (3.42), 
this implies e • X n (e) — e • N n > 1. Let r e = inf{t > e: e • X n {t) = e • N n }. 
Notice that t £ is well defined since the jumps of e • X n are of size 1 and, 
moreover, satisfies tv < 2e on fl n , because the total queueing time does not 
exceed e. Using e • X n (e) — e ■ N n > 1, (3.1), Lemma 3.6 and (3.38) we can 
write 


0 = e • X n (r £ ) -e-N n 

> e • X n (e) -e-N n + e- W n (r £ : e) - e 1 / 3 (l + |(e ■ X n ) + |^) 
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implying 

(3.43) |(e • X n ) + \*^ > e _1/4 . 

In other words, a large queue of at least e ^ 1 / 4 has to be eliminated before 
time t £ . Let a be the last time before r e , satisfying \(e-X n ) + \*^ = e-X n (a) > 
e" 1 / 4 . We have 

0 = e • X n {r e ) -e-N n 

> e • X n (a) -e-N n + e- W n {r e : a) - e 1 / 3 (l + e • X n (a)) 

> C + ±e ■ X n {a) >C + (l/2)e -1 / 4 , 

for some constant C, which is an obvious contradiction for e small enough. 

Case 2. If eV 3 |(e • X n ) + \* > e ■ X n (s) -e-N n , then |(e • X n )+\* £ > e" 1 / 3 
by (3.42), and the same considerations as in the previous case can be applied. 
Let a be the last time before e, satisfying |(e • X n ) + \* E = e ■ X n (a ) > e -1 / 3 , 
and define T a = inf{t > a: e ■ X n {t ) = e • A^ n }. Then 

0 = e • X n (T a ) - e • N n 

> e • X n {a) — e • N n + e • W n (r a : a) - 2e 1 / 3 (l + e • X n (a )) 

> C + \e ■ X n (a ) > C + (l/3)e _1/3 , 

for some constant C, giving the contradiction once again. This concludes 
the proof of Theorem 2.4. 

4. General structures. Theorem 2.4 shows that null-controllability is im¬ 
possible if the underlying fluid model is throughput optimal. The result is 
valid for the case min{/, J} = 2, and the assumption is crucial for both The¬ 
orem 3.4 and Lemma 3.6. How can Theorem 2.4 be extended for general / 
and J, especially, since it is relatively easy to numerically check conditions 
(3.13)-(3.14) (enough to check separately for each zero path)? We give a 
partial answer. 

Definition 4.1. A path p e SP is called class-dependent if (3.6)-(3.8) 
(4.1) = 


There are only two summands for each given i in (4.1). Basically, the 
definition says that for each i £ I. belonging to p, and two (just these two!) 
adjacent activities and (z, j’ 2 ) from the very same path p, we must 

have fiij 1 = Pi.j 2 . Similarly, we have the following: 
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Definition 4.2. A path p e SP is called pool-dependent if 

(4.2) ^2 s(p,i,j)nij = 0, j€j. 

i:{i,j)eS p 

From (3.6)-(3.8), each of the above two types must be a zero path, that 
is, p(p) = 0 . 

Theorem 4.3. Let Assumptions 2.1-2.3 hold, and let I, J> 1. Assume 
that the fluid model is throughput optimal and satisfies one of the following: 

( 1 ) has no zero paths, that is, Vq = 0; 

(2) each p E Vo is either class- or pool-dependent; or, for small k > 0 , 

(4.3) £ Pij(ipij — ip*j) < 0 whenever if E 'E(x* + m p n, v). 

ij 

Then it is impossible to find T > 0 and a sequence of SCPs, satisfying (2.9); 
that is, (weak) null controllability is impossible. 

Remark 4.4. Currently this is as close as we can get to the conclusion 
that, in the general case, (3.13)-(3.14) prescinds null controllability (for 
throughput optimal fluid models). Apparently, more work is required when 

(4.3) results in equality, with path being neither class- nor pool-dependent. 
We feel, however, that such situations are very rare, maybe even impossible 
(and may as well contradict to uniqueness of the underlying fluid model; see 
Assumption 2 . 2 ). 

Remark 4.5. Theorem 4.3 trivially implies that null-controllability is 
also impossible for either one of the following types of the fluid model: 

( 1 ) the service rates depend only on the class type (class-dependent ), 

(4.4) Hij = fJu i€l,jej] 

( 2 ) the service rates depend only on the station type (pool-dependent ), 

(4.5) pij = [ij , iel,jej. 

Indeed, in both cases the fluid model is throughput optimal, and all paths 
are either class- or pool-dependent. 

Proof of Theorem 4.3. It will be enough to show that relation (3.28) 
of Lemma 3.6 remains intact, as no other part of the proof of Theorem 2.4 
has any structure constraints. 

Case 1. Relation (3.28) trivially follows from the current proof of 
Lemma 3.6. 
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Case 2. The argument goes exactly as in the proof of Lemma 3.6, until it 
gets to (3.32), stating that at least one “large” zero path has been activated. 
Some extra work has to be done at this point. 

A. All zero paths are class-dependent : in such case [see (3.6)—(3.8)] we 
have ||m p || = 0 for each zero path; hence none of these paths has any effect 
on the system. Once again, (3.28) follows trivially. 

B. All zero paths are pool-dependent: assume that all zero paths satisfy 
(4.2). We start with the case when there is only one zero path p. The follow¬ 
ing estimate will be useful. From the exact structure of from Theorem 3.3, 
and (3.10), we have a crude estimate 

(4.6) \X?(t)\ < g _1 / 3 (! + (e • X n (t)) + + e • if(t)), i £ V p , 


since no zero paths have been applied to such classes i. Now, for any fea¬ 
sible allocation T n (f) consider a unique, standard, [ 1 , 2 ] allocation (f> n (t) £ 
'B(X n (t),N n ) that is zero for nonbasic activities and is work conserving: 
min{(e • X n (t ) — e • N n ), (e • N n — 0™(f))} = 0. By throughput optimal¬ 

ity of the fluid model [i.e., V- = 0; see the definitions before (3.10)], we must 
have Ylij - HijlHjtijit). Using (4.6) and the structure of cj) n , 

(4.7) |^.(f)| < g- 1 / 3 (l + (e • X n (t)) + + e • ^(t)), (i,j) £ £ p , 

as well as 

(4.8) l?“ A (t)l < e- 1/3 (1 + (e ■ X’‘(t))+ + e ■ ?“(<)) 

for the leaf (■ io,jo ) of the basic simple path, corresponding to p. Together, 
(4.7), (4.8) imply that for each station j £ J fl V p , connecting exactly two 
path edges {i\ ,j) £ £ p and (i 2 ,j) € £p [this excludes the leaf from (4.8)], we 
also have 


(4.9) j(t) + + (e • X"(t))* + e • ?■(«)) 

and due to pool-dependence along the path (4.2) (otherwise it will not hold!), 
we get 


(4.10) 




< Aiu j-e- 1/3 (l + (e • X n (t)) + + e ■ rf(t)). 


This proves (3.28). The extension to several pool-dependent paths is straight¬ 
forward—the only difference being the inclusion of all pool-dependent ac¬ 
tivities (possibly more than two), connected by station j, into the left-hand 
side of (4.10). The right-hand side of (4.10) will remain the same. 


NECESSARY CONDITION FOR NULL CONTROLLABILITY 


21 


C. All zero paths satisfy (4.3): by linearity, there exists a constant c > 0, 
such that for any feasible set {M p > 0 ,p G Vo} and if G 5(x* + m p M pi v) 

(4.11) ~ iftj) <-c^M p < -e 1/2 ^ \\ m p\\ M P- 

ij p&V o p&V o 

Note that the first inequality in (4.11) becomes an equality if and only if 
each of the M p is zero. Applying (4.11) to processes from (3.10) and using 
Theorem 3.3(2), we get for any feasible allocation 4' n (t), 

£#%%*) < -£ 1/2 |rWII +ec F (\\X% + ||jV"||) 


(4.12) 


+ e" 1/3 (l + e-rT(t)). 


Using relation (3.31), we continue 

X>«$5(‘) < -£ 1/2 ||f“(t)|| +A 6 (1 + HC”(t)ll +e-!T(t)) 

ij 

(4.13) 

+ £-V 3 (l + e • rT(t)) < e- 1/3 (l + e • if (f)), 

where we used ||C n (t)||(—e 1//2 + e 5//6 + e 5 / 6 ^ 1 ^ 6 ) < 0 [again, the strict inequal¬ 
ity in (4.3) is crucial for the existence of the e 1 / 2 ” term!]. And (3.28) 
follows. 

D. Finalizing: we use B and C to complete the theorem. In particular, 
once again, the ( work-conserving, no nonbasic activities ) allocation <p n will 
be introduced. After that, the sum Ylij l i ij4 > i'j('t) w iU be decomposed into 
two different sums: one will contain all the terms satisfying (4.7)-(4.10) 
[this will also include the possible intersections of pool-dependent paths and 
paths, satisfying (4.3)]; another part of the summation will satisfy (4.13). 
This completes the proof. □ 


5. Final remarks. The text is an attempt to understand whether a given 
static fluid model is throughput optimal; and some words need to be said 
regarding Assumption 2.2, in particular, (a) the treelike structure and (b) 
the uniqueness of the solution to (2.4) in general. 

(a) To start with, null controllability is clearly impossible if the solution 
to (2.4) does not contain a basic path of the length at least 3 (we need 
to have at least two stations and two classes to be connected together by 
basic activities), so some kind of connectivity should be assumed. When a 
connected component contains cycles fully composed by basic activities, one 
may have trouble defining weights/directions along simple paths (as was 
done in Section 3.2), yet one thing will remain true: a throughput optimal 
model can only have cycles with weight zero. Otherwise, a positive path can 
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become negative if applied in the other direction, and vice versa. This brings 
us back to the very same zero paths, main ingredients of the current paper. 

(b) A mass vector x*, coming from the solution of (2.4) is a key (!) element 
due to Assumption 2.3 about the initial condition. This invites a reasonable 
question. What if there is another optimal solution, with the same vector 
x*, but a different graph structure? This is clearly feasible, although both 
(or, infinite number, in that case) possible static fluid models would still 
be either all throughput optimal, or sub-optimal altogether, since definition 
(2.7) does not require any special graph structure. 

Now, what if the other solution has a different mass vector, say, x**. Is it 
possible that absolution is throughput optimal, while x** is not? We claim 
it is not feasible, at least in the case I = 2 or J = 2 , with arguments similar 
to ones in the proof of Theorem 3.4 (since e ■ x* = e • x**). The more general 
structure is still to be resolved.... 

APPENDIX: SKETCH OF THE PROOF OF THEOREM 3.3 

Using the scaling / = n -1//2 /, introduce auxiliary processes Y™(t), repre¬ 
senting the scaled number of class-i customers that are in the queue (and 
not being served) at time t, and Z"(t)—the scaled number of servers at 
station j that are idle at time t. Clearly, we have the following relations: 


(A.l) 

Y?{t)+Y J %{t)=xm 


i eJ 

(A.2) 

%(‘) + X *”P) = A”. 


iei 


The proof can be viewed as generalization of Theorem 2.1 from Atar, Man- 
delbaum and Shaikhet [5], whose decomposition used only closed simple 
paths (called cycles). In particular the set {4 , A,(z,j) € £ a } was decom¬ 
posed into basic and nonbasic activities, respectively, {4'it, (i,j) G £b a } and 
( i,j ) G £f> a }-, turning (3.1) into (see Section 2.3 in [5]) 

xm = X? (0) + Wf(t) - ]T f Gij(X n (s) - Y n (s),N n - Z n {s)) ds 

jej Jo 

+ X mi ’P J 

p:p-closed simple path 

where 'k” corresponds to a unique nonbasic activity, associated with simple 
path p and the function G, introduced in [1], 

For our purposes, however, that is not enough, since we want to single 
out all the terms that can cause an abrupt change of X n , and nonwork 
conservation is exactly what we are looking for, since, a priori we do not 
have the relation e • Y n A e • Z n = 0. 
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The rest of the proof follows the lines of Theorem 2.1 in [5], with an 
additional requirement to cover direct nonwork conservation, that is, situ¬ 
ations when Y™ A ZJ > 0 while p t j > 0, as well as the open simple paths, 
corresponding to what we call an indirect nonwork conservation, that is, 
situations when Y'f 1 A Z™ > 0 while \JL Vj = 0. We leave out the details. 
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